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In problems of control of technological processes, algorithms for identifying the parameters of a control 
object (CO) based on the least squares method (OLS), as well as various variants of the stochastic 
approximation algorithm [ 1 ], are most often used . 


The algorithm of the recursive least squares method [2 , 3] makes it possible to refine the estimates at each 
step of the arrival of new CO measurements and is written in the form: 


C(n+1)t =C(n)+P(n+1)tX(n + 1)[Y(n+1)— X(n + 1)C(n)] (1) 

P(n +1)! = P(n)! — [P(@) 1X7 (n + 1)][1 + X(n + 1)P(m)71 + XT (n + DIP n) X(n + 1)] 7; 
(2) 

where C(n + 1) is a vector parameter; - discrete time; P (n + 1) - matrix of size (n + 1)(n + 1); X(n + 1) 


- vector of measurements of the object input at the (n + 1)-th clock; Y(n -+ 1) measurement of the scalar 
output of the object at the (n + 1)-th clock. 


The least squares method for a sequence of observations is also recurrent, i.e. solves the problem of 
improving the old estimate C ( ) [4]. In this algorithm, the next value of the vector of estimates of the 
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parameters of the object is selected as the previous one, corrected by the value of the vector of the difference 
between the true parameters of the object and their estimates C(n): 


C(n) = C(n— 1) -TAC (n) = C(n — 1) +TM (n) — Cr - DX MJX XM] XN) T; (3) 
where I ( )is the gain matrix. 


In [36], it was proposed to use a simplified one-step algorithm ( = 1), named after the author by the 
Kachmazh algorithm. The algorithm uses equation ( 23 ), which is transformed to the form: 


Y(n)-C(n-1)X(n) « XT (n); 


Cin) = Cm —1) + XT (n)x(n) (4) 


where Y (n) is the scalar output of the object; X (n) - vector of CO observations at the n-th step; C (n), C (n - 
1) - vectors of the object parameters at the n-th and (n - 1) -th steps. 


The popularity of this algorithm is explained by the small amount of calculations required to recalculate the 
estimate when new measurements are obtained, and the small amount of memory required when 
implementing this algorithm on a computer. In addition, algorithm (4 ) can be applied in the presence of 
small measurement noise and slow drift of the parameter vector, while obtaining an acceptable accuracy of 
estimates. 


The characteristics of the algorithm ( 4 ) essentially depend on the properties of the vector X (n). So, if the 
vectors X (1), X (2), ..., X (N) are mutually orthogonal, then "in exactly N measurements, the exact value of 
the sought vector C will be obtained. If X (n) is vector white noise with independent components and equal 
variances, it can be shown that the convergence time is 


(4 +5) N [7]. An increase in the temporal correlation in X (n) leads to a significant increase in the 
convergence time of the algorithm and, therefore, deteriorates the accuracy of the parameter estimation 
during drift. 


The paper [ 23 ] proposes a method for accelerating the convergence of the Kachmazh algorithm, which 
consists in introducing, along with the main algorithm, a correcting algorithm. The resulting set of 
algorithms forms a generalized algorithm that looks like: 


C(n- 1) = C(m=1) + aln)(C(m— 2) - Cin- D); Cm) = Cln - 1) + SEO a xT); 
(5) 
Where 
ose - if a P?(C(n — a. > P*(c(n — 2),C(n- 1), (6) 
otherwise, 
p2 (C(m), (C(k)) = (¥@)—C(m) XK)? (7) 


XT(k)X(k) 


In [31], a high-speed robust (insensitive to variations in the noise distribution density) identification 
algorithm was proposed, which makes it possible to obtain effective estimates of the CO parameters under 
the influence of unsteady contaminated Gaussian noise on the CO. The essence of the algorithm is to replace 
the quadratic loss function F (e) = e 7, where 


e = Y - Y is the residual of the output signals of the real OA and the model, a square-linear loss function 


F(e) = he lel <A 


lel, lel >A (8) 
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which leads to the following change in algorithm (24 ): the residual value 

e (n) = Y (n) - C (n- 1) X (n) is replaced by the value of the bounded residual e og (n) 
i ei l e(n)at|em)| < A(n — 1) 

limited — lA(n — 1) sign e(n) at |e(n)| > AQ — 1) 


where A (n - 1)=Cp[e (n - 1)]; C p- the parameter of robustness, depending on b - the degree of pollution of 
the Gaussian distribution; 


(9) 


[e (n - 1)] - the estimate of the final realization of the standard deviation of the random variable e at the (n - 
1) th cycle. 


Due to the nonstationarity of the Gaussian component of the noise, the considered algorithm adapts the 
variance of the residual using the recurrent procedure: 


M [e(n)] = (1 — a)M[e(n — 1)] + ae(n); 


M [e2(n)] = (1 — a)M[e2(n — 1)] + ae2(n); (10) 


1—a/2 
1—a 


ê [e(n] = /{M[e?(n)] — M?[e(n)]} 


J 


where , and - estimates for the final implementation, respectively, of the mathematical expectation, the 
mathematical expectation of the square and the standard deviation of the random variable e at the th cycle; a 
is the smoothing coefficient, 0 <a <1. To eliminate the bias of the estimate 7, multiplication by (1 - a/2)/(1 


- a) is performed. 
In the general case, when the vector C is nonlinear, it is impossible to find an analytical expression for the 


optimal vector C “. Therefore, various approximate methods are used for solving equation [ 8], which is an 
optimality condition: 


VICC) = M{VcF [em] = 0, (11) 


where M is the symbol of the mathematical expectation; J (C),- gradients of average losses and loss 
functions, respectively. 

Most of these methods are successive approximation methods. Their physical meaning is to replace the 
"static" equation, which is the optimality condition, by the "physical" one - a difference equation, the 
solution of which C ( ) with time — œ c tends to the optimal vector C * (see, for example, ( 4 ), (5) Such 
a difference equation underlies the stochastic approximation algorithm: 

C(n) = C(n — 1) -—T(@)V,-F[e(n)]. (12) 


The specific form of the gain matrix I (n) is determined by a particular method of stochastic 
approximation. Scalar matrix T (n) = y (n) * e, y (n)> 0 corresponds to the gradient method, bias T (n) 
=yi(n) * e,yi(n)> 0, 1 = 1,Kand G (n) =y (n) *B, B> 0 corresponds to the pseudo-gradient 
method. Here y is the coefficient ensuring the monotonic nature of the identification process; K is the 
dimension of the vector C; B is a positive definite matrix [25-33]. The coefficients y (n) and y (n) must 
satisfy the Robbins - Monroe conditions: 


a)yi(n)>0, b) E-117: (n) =, c) Ep- yf (n) < œ, (13) 


which ensure the convergence of recurrent algorithms (1.23) for a wide class of loss functions F (e) and 
distribution densities of noise P (6). 
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Slow convergence characteristic of procedures (3 2 ), the existence of a transient process determined by the 
choice of the initial value C Q , and a strong dependence of the rate of convergence on y (n) led to the use of 
the recurrent OLS algorithm in problems of technological process control and, in particular, the Kachmazh 
algorithm ... 


Thus, when developing control algorithms and optimizing formalin production for high-quality and fast 
adaptation of the parameters of control models, one should focus on the use of identification algorithms 
based on recurrent OLS, including a simplified version of Kachmazh. 
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